Effect of Response Mode and Subject Characteristics 
On Learning in Programed Instruction 


Abstract 


60 Ss took a program in one of three ways: 
writing the answer, ‘thinking’ the answer 
without writing it, or reading a program with 
the answers filled in. Results indicated no sig- 
nificant differences among the groups on two 
measures of amount learned. Low positive cor- 
relations were obtained between amount learned 
and IQ and reading comprehension of the Ss. 
Percent error on test frames within the program 
was negatively correlated with adjusted gain 
scores (r= —0.71). Results were also related 
to possible pragmatic applications. 


A common assumption in programed 
instruction has been that overt re- 
sponding (verbal, written, or manipu- 
lative), suitably reinforced, leads to 
greater learning than does covert re- 
sponding (Holland, 1959). Early evi- 
dence contrary to this assumption was 
presented by Evans (1960). His results 
were further substantiated by Alter 
and Silverman (1962), Krumboltz and 
Weisman (1962), Goldbeck and Camp- 
bell (1962), Wittrock (1963), Tobias and 
Weiner (1963), and Feldman (1965). 
Tobias and Weiner conclude their study 
of response modes with the statement 
that, “The crucial experiment in this 
area would be one with a long, well- 
standardized program, used in a con- 
ventional course of instruction (1963, 
p. 13).” The present study is such an at- 
tempt to investigate the effects of 
varying response parameters in the 
context within which they are design- 
ed to operate: that is, the classroom. 


Method 


Program. A programed course of 
instruction in ratios and proportions 
constructed by the General Programed 
Teaching Corp. was taken by all three 
groups. The program used is an espe- 
cially good one, as is evident in an 
evaluation and comparison of it with 
other programed texts conducted by 
McGuigan (1965). The program con- 
tained 1344 frames, of which 69 were 
test frames to which the correct ans- 
wer was not available to the student. 
These frames were labeled TEST and 
were distributed at variable intervals 
throughout the program. Most of the 
frames were of the constructed response 
type although some frames were of the 
true-false or multiple-choice variety. 
A special slider template was used with 
the programed text to cover the cor- 
rect answer and the next frame while 
the student read and responded to each 
frame. 

Subjects. The Ss were 60 sixth grade 
students in two classrooms in the Roa- 
noke, Virginia, City Public School Sys- 
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tem. They were randomly assigned to 
three groups of 20 each and there 
were an equal number of Ss from each 
class in each group. Lorge-Thorn- 
dike Intelligence Test scores and scores 
on the Reading Comprehension Scale 
of the Science Research Associates 
Achievement Test were obtained from 
the school records of these Ss. 


Procedure. The program was admin- 
istered by the teachers to a group of 
the elementary school students for 
whom it was designed, as part of the 
regular arithmetic work at the time 
when ratios and proportions would 
normally have been taught. This was 
done so that the motivational and at- 
tentive levels of the students would be 
on as nearly as possible the same as 
that on any other school day. The arith- 
metic period, during which the program 
was administered, lasted approximate- 
ly 45 minutes each day. The students 
were not told that they were involved 
in an experiment; but, although pro- 
grams have been used in the Roanoke 
schools for several years, they were 
probably aware of the fact that they 
were not all taking the program in the 
same manner. 


The overt responding (OR) group 
took the program in the normal man- 
ner, writing their responses in the 
book and then moving the slider to 
confirm the answer. The covert re- 
sponding (CR) group followed a simi- 
lar procedure except that they were 
instructed not to write in the pro- 
grams; but to the TEST items all 
groups wrote their responses. They 
were to read the frame, think of the 
answer, and then move the slider to see 
if they were right. The no-response 
(NR) group read a program which had 
the answers already filled in and the 
response confirmation portion of the 
frame blacked out. 


A 40 item multiple-choice achieve- 
ment test devised for use with the 
program by the General Programed 
Teaching Corp. as a pre- and post-test 
was used by the teachers. 


Results 


One-way analyses of variance con- 
ducted among the three groups on pre- 
test scores, IQ’s, and reading compre- 
hension scores failed to indicate any 
significant differences at the .05 level 
among groups on these variables. An 
adjusted gain (G) score was obtained 


by dividing the actual gain (post-test 
score minus pre-test score) by the pos- 
sible gain (total score possible on the 
test minus pre-test score). McGuigan 
(1963) has found this G score to be a 
more accurate index of achievement 
since it adjusts for differences in indi- 
vidual’s prior knowledge as exhibited 
in pre-test scores. Analyses of variance 
of the two indices of achievement, per- 
cent error on the test frames and G 
scores, also failed to reach significance, 
again at the .05 level. (Tables 1 and 2). 
Results of a Duncan’s Range Test indi- 
cated a significant difference between 


TABLE 1 


Summary of Analysis of Variance of 
Percent Error on Test Frames 


Source af Mean Square F  _p 
Among Groups 2 84.69 1.10 >.05 
Within Groups 57 76.96 
Total 59 


TABLE 2 


Summary of Analysis of Variance 
for Adjusted Gain (G) Scores 


Mean- 

Source af Square F_ Pp 
Response Mode 2 0.02 0.40 >.05 
1Q 1 016 3.20 >.05 
Mode x IQ 2 0.00 0.00 > .05 
Error 42 0.05 
Total 47 


the OR and NR groups on time to com- 
plete the program. Table 3). 


TABLE 3 


Results of Duncan’s Range Test 
Among Groups on Time in Minutes to 
Complete the Program 


OR Group CR Group NR Group 
482.45 425.25 386.45 


Any two treatment means not underscored b 
the same line are significantly different (p<.05). 


Any two treatment means underscored by 
the same line are not significantly different. 


G scores were found to be signifi- 
cantly correlated with IQ(r=0.34, p< 
.05) but not with reading comprehen- 
sion (r=0.21). Percent error on the 
test frames and G scores were also cor- 
related (r= —0.71, p<.01). 


Significant correlations were found 
to exist between IQ and G scores for 
the OR group (r=0.39, p<01) and for 
the CR group (r=0.38, p<.01) but not 
for the NR group (r=0.22). A Y2 Test 
of Homogeneity or r’s did not, how- 
ever, find these correlations to differ 
significantly from each other Oe= 
0.368). 


The G scores of the NR group were 


significantly correlated with scores on 
the reading comprehension test (r= 
0.36, pZ.01) but these two variables 
were not significantly correlated in the 
OR group (r=0.14) or in the CR group 
(r=0.17), A°Y2 Test of Homogeneity of 
these r’s failed to yield significance 
(¥2=0.461). 


Overall, it can be said that all cor- 
relations between G scores and sub- 
ject characteristics were low. A sum- 
mary of means of measures of achieve- 
ment and time to complete the pro- 
gram is presented in Table 4. 


TABLE 4 


Means of Measures of Achievement 
and Time to Complete the Program 


OR CR NR 
Group Group Group 
Mean % Error on 
Pre-test 49.5 50.9 43.0 
Mean % Error on 
Post-test 79.5 78.9 73.7 
Mean % Gain 30.0 28.0 30.7 
Mean (G) Score 0.61 0.61 0.55 
Mean % Error on 
Test Frames 8.7 11.4 12.7 
Mean Time to Com- 8hr. 7 hr. 6 hr. 
plete Program 2 min. 5 min. 26 min. 


The analysis of variance in Table 2 
is for a 3 x 2 factorial design with 8 
Ss per cell and shows that the Ss with 
high 1Q’s did not achieve significantly 
higher G scores than the Ss with IQ’s 
below the mean in each group. A zero 
interaction was found between IQ and 
response mode with respect to G scores. 


Discussion 


Since there were no significant dif- 
ferences among the three groups in 
IQ, reading comprehension test scores, 
and pre-test scores, the assumption 
that the groups were equivalent prior 
to taking the program seems to be jus- 
tified. 


The results of this study confirm 
those of Alter and Silverman (1962) 
and a number of others previously cit- 
ed, (eg., Krumboltz and Weisman, 
1962; Goldbeck and Campbell, 1962; 
Wittrock, 1963; Tobias and Weiner, 
1963; Feldman, 1965) in failing to show 
significant differences in achievement 
among groups using the different re- 
sponse modes of writing their re- 
sponses, thinking them, and reading an 
altered program. Perhaps the effective- 
ness of programs for some subject pop- 
ulations is as much a function of syste- 
matic presentation of the “bits” of in- 
formation as it is of the reinforcement 
contingent upon individual overt re- 
sponses. That is, when information is 
presented in a systematic programed 
form, adequate reinforcement provided 
at the end of the chain of responses 
which comprise the program may be 
sufficient to maintain the desired be- 
havior. What constitutes adequate re- 
inforcement is an empirical question 
depending on the reinforcement his- 


tories of the subjects; for other popu- 
lations, such as the culturally deprived 
or mentally retarded, stronger and 
more frequent reinforcement contin- 
gencies would still seem indicated. 
Nevertheless, since it may take less 
time to complete a program which does 
not require responses as such, it might 
be wise to consider for some applica- 
tions, the advantages of simply pre- 
senting the information to be learned 
in systematic step by step form, with- 
out requiring written responses, and 
providing suitable reinforcement con- 
tingent on completion of the program. 


The low correlation of the G scores 
with IQ and their nonsignificant cor- 
relation with reading comprehension 
further emphasize the inherent advan- 
tages of programed instruction in 
teaching students of lesser ability, since 
the effects on performance of individ- 
ual differences in these abilities are at 
least minimized. It seems that indi- 
vidual differences among the Ss on 
this program appear more as differ- 
ences in time to complete the program 
than as differences in final perform- 
ance. This effect has also been noted 
by Carroll (1963). 


The percent error on the test frames 
within the program was highly nega- 
tively correlated with the G scores 
(r=-—0.71). Since error rate on the test 
frames is so well correlated with G 
scores it seems safe to assume that er- 
ror rate on the other frames would be 
similarly correlated, which would sup- 
port the Skinnerian position on reduc- 
ing error rate on programs. to the low- 
est level possible (Skinner, 1954; Zea- 
man, 1962). 


The fact that the G scores of the high 
IQ group were not significantly higher 
than those of the low IQ group is evi- 
dence that programing can minimize 
the effect of individual differences on 
performance. Furthermore, it is inter- 
esting to note that the NR group had 
the lowest correlation of IQ with G 
scores, even though this correlation did 
not differ significantly from those of 
the other two groups. The G scores of 
the Ss are not differentially affected 
by IQ since the results of the analysis 
of variance also show no interaction 
with response mode. 


An interesting point for speculation 
arises in the results of comparison of 
the reading comprehension correla- 
tions. Reading comprehension is not 
significantly correlated with achieve- 
ment for the sample as a whole or for 
either the OR or CR groups but is cor- 
related at the .01 level of significance 
for the NR group, who read the altered 
program. If this effect does in fact ex- 
ist it would seem judicious to require 
only those with poor reading compre- 
hension to make overt responses while 
others take the program using less 
time-consuming response modes. Fur- 
ther research with this parameter of 


programed learning would seem to be 
worthwhile. 


It should be noted that the above 
conclusions are not necessarily univer- 
sal for all programs, particularly in the 
case of material of a different degree 
of difficulty. 
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